Hand-eye Coordination for Grasping Moving Objects
نویسندگان
چکیده
Most robotic grasping tasks assume a stationary or fixed object. In this paper, we explore the requirements for grasping a moving object. This task requires proper coordination between at least 3 separate subsystems: dynamic vision sensing, real-time arm control, and grasp control. As with humans, our system first visually tracks the object's 3-D position. Because the object is in motion, this must be done in a dynamic manner to coordinate the motion of the robotic arm as it tracks the object. The dynamic vision system is used to feed a real-time arm control algorithm that plans a trajectory. The arm control algorithm is implemented in two steps: 1) filtering and prediction, and 2) kinematic transformation computation. Once the trajectory of the object is tracked, the hand must intercept the object to actually grasp it. We present 3 different strategies for intercepting the object and results from the tracking algorithm.
منابع مشابه
Grasping of a moving object with a robotic hand-eye system
Most robotic grasping tasks assume a stationary or xed object. In this paper, we explore the requirements for tracking and grasping a moving object. The focus of our work is to achieve a high level of interaction between a real-time vision system capable of tracking moving objects in 3-D and a robot arm equipped with a dexterous hand that can be used pick up a moving object. We are interested i...
متن کاملAutomated Tracking and Grasping of a Moving Object with a Robotic Hand-Eye System
Most robotic grasping tasks assume a stationary or fixed object. In this paper, we explore the requirements for tracking and grasping a moving object. The focus of our work is to achieve a high level of interaction between a real-time vision system capable of tracking moving objects in 3-D and a robot arm with gripper that can be used to pick up a moving object. There is an interest in explorin...
متن کاملLearning Hand-Eye Coordination for Robotic Grasping with Large-Scale Data Collection
We describe a learning-based approach to hand-eye coordination for robotic grasping from monocular images. To learn hand-eye coordination for grasping, we trained a large convolutional neural network to predict the probability that task-space motion of the gripper will result in successful grasps, using only monocular camera images and independently of camera calibration or the current robot po...
متن کاملLearning Hand-Eye Coordination for Robotic Grasping with Deep Learning and Large-Scale Data Collection
We describe a learning-based approach to handeye coordination for robotic grasping from monocular images. To learn hand-eye coordination for grasping, we trained a large convolutional neural network to predict the probability that task-space motion of the gripper will result in successful grasps, using only monocular camera images and independently of camera calibration or the current robot pos...
متن کاملBiologically Motivated Hand-Eye Coordination for the Autonomous Graspin of Unknown Objects
In the eld of visually guided grasping, humans still outshine their robotic counterparts with respect to accuracy, speed, robustness, and exibility. We therefore examined current neuroscientiic models for the control of human reach-to-grasp movements and, based on one of them, developed a novel visual motion control strategy. This control strategy was integrated into a complete hand-eye system,...
متن کامل